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Agenda 


SUSECON digital? 


1. Quick Survey of the Storage 
Landscape 


2. Detailed look at the SSD 
World 


3. NVMe and SLE 


4. Where are we headed? 
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What 5MB Looked Like in 
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Magnificent Journey of Magnetic Hard Disk Drive Technology 
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L4 Derai Ee @ Consumer HDD 
Source:  Wikibon, 2021. Projections 2021-2030 by Wikibon. Historic data from multiple sources, including IDC, Gartner, Kitguru, Nidec, & Trendfocus. 


Figure 7 - History and Wikibon Projection of HDD Shipments (millions) 
Source: © Wikibon 2021 
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SSD is Cheaper than HDD in 2026 and Beyond 
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Figure 4 - SSD/HDD Pricing Ratio 2013 - 2030 
Source: © Wikibon, 2021. 


Logorithmic Plot of SSD/HDD $/TB Ratio 
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Storage Formats 


— Hard Drives 





— SATA 
— 2.b5inch (almost strictly consumer at this point) 
— 3.5inch 
— SAS 
= 3 5 inch "File:5.25 inch MFM hard disk drive.JPG" by User Redgrittybrick on 


en.wikipedia is licensed under CC BY 2.5 (111 MB !!) 





— 2.5 inch (almost gone - still some floating about in the 
channel) 


— Fibre Channel 


— Kaput! 
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Storage Formats 


— SSD 
— SATA 
— 2.5inch (aka U.2) 
— M2 
— M.3 
— M-SATA (giving way to M.2) 
— SAS 
— 2.5 inch 
— NVMe 
— M.2 
— 2.5 Inch 
— PCle Add in Card (AIC) 
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Solid State Drives 
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It's all about the NAND! 
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Types of NAND 


Greater capacity because curren 
also flows vertically in a stacked 
structure 






— SLC (All but gone....) 


Direction of 
current flow 





— MLC 
— TLC 
— QLC (Beware...) 


— PLC (not quite yet) 


Schematic structure of planar NAND Flash 
DIE Architecture 
— 2D NAND (gone....) 


— 3D NAND 





SSD Endurance 


— Enduranceis reference to how many writes the NAND can handle over 
the drive's lifetime 


— Writes are not really the problem; the issue is the Erase function. 


— Erases only happen a block at a time. Writes can only occur to pages on 
erased blocks. 


— Alot of writes mean a lot of erases...... 


— Look for Drive endurance in the Datasheet. 
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"Pencil" by taylor.a is licensed under CC BY 2.0 e) à 
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So what 


should you 
do? 


Warranty is not the same as Endurance. 





Buy the right tool for the job. 


Beware of No-Name Brands! 





Find and Read the Datasheets! 
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NVMe and SLE 


Non-Volatile Memory Express 
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History of NVMe 


— Fusion-io Started this whole mess.... 


Proprietary design and drivers 
Proved the Concept 


— System based processors(cores) and memory much faster 
than an FPGA or ASIC 


—  PCle much faster than SATA, SAS, or Fibre Channel 
— Removes the HDD cruft from the Protocol 

Made the Founders Rich! 

Sold out to SanDisk in 2014 


— NVMe was "Open" Response to FIO 


Intel big leader here (driven by Hyperscalers) 
More or less, the same concept as Fusion-io 
"In-box" Drivers (Windows and Linux) change everything. 


Multiple vendors drive down prices 
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Hardware Architecture of NVMe (vs other SSDs) 





CPU 0 








NVMe Drives 
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NVMe 
Su pport In Built-in Drivers are wonderful! 


SLES 





SLE support imputes full support to 


Rancher and RKE running on top! 











Hardware Architecture of NVMe-OF 


CPU O 











NVMe Drives 





Fabric 





NVMe Drives 
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NVMe Over 
Fabric 


SLE Includes software for both Client and 


Target 





Multiple Hosts can access the same devices 





You Need a LOT of Network 





Where are We Headed? 


If you don't know where you are going, you might wind up 
someplace else. 


Yogi Berra 
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EDSFF 


— Enterprise and Data Center SSD Form Factor 


— E1.L, EDSFF 1U Long 
— 318.75mm (^12.5 inch) 








— E1.S, EDSFF 1U Short " 
— 111.49mm and 118.75mm (^4.4 inch and 4.7 inch) 


— EDSFF E3.S and E3.L 


— Well, we will see..... a 





3840GB 
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Other Storage Device Trends.... 


— The demise of SATA SSD 
— Already occurring on some systems. 


— What happens to SAS? 


— NVMe AIC Form Factor 


— Hanging in there..... 


— Hyperconverged 
— Easy and Cost effective for on-prem 


— Ceph gives way to Longhorn (at SUSE anyway) 
— Will Hyperscaler's adopt NVMe over Fabric? 


— SAN Storage for On-prem? Will NVMe-OF see wide adoption? 
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Resources 


— https://blocksandfiles.com/2021/01/25/wikibon-ssds-vs-hard-drives-wrights-law 





— https://nvmexpress.org /wp-content/uploads/NVMe Over Fabrics.pdf 
— https://documentation.suse.com/sles/15-SP1/html/SLES-all/book-storage.html 


— https://www.snia.org/forums/cmsi/knowledge/formfactors 
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SUSECON digital? 


Thank you for attending. 


Continue the conversation in the SUSE & Rancher Community 
at community.suse.com. 


Visit www.susecon.com for new technical content and information about 
upcoming SUSECON events! 
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Hard Disk Drives 


1950s Technology Still in use in the 
21st Century! 
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Hyperscaler's Rule the World in HDD 


— Requirement: 10 IOPS per TB 


— Density, Density, Density 


— Form Factors may change in the future! 
— 3.5 inch May Go Away.... 


— (Seefirst requirement) 







— 2.5inch gone in Enterprise ( 


Western Digital. 


! Ultrastar 
|; DC HC650 


HelioSeal 
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HAMR, MAMR, SMR ? 
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"Jet Engine Flamethrower" by jurvetson is 
licensed under CC BY 2.0 





"Roofing Shingles" by Eilter Forge is licensed 
under CC BY 2.0 


"Hammer" by HomeSpot HQ is licensed under CC 
BY 2.0 


Too Little, Too Late 


—",...disk technologies like HAMR and MAMR will not change the 
outcome as it will not be financially viable for the HDD manufacturers 
to introduce them in mass quantities. This is because the number of 
drives required to reduce HAMR/MAMR costs below current HDD 
recording technology costs is too great." 


Wikibon Research analyst David Floyer 


